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Section 11 



Lindeberg's CLT. Levy's Equivalence 
Theorem. Three Series Theorem. 



Instead of considering i.i.d. sequences, for each n > 1 we will consider a vector (X", . . . , XJl) of independent 
r.v., not necessarily identically distributed. This setting is called triangular arrays because the entire vector 
may change with n. 

Theorem 25 Consider a vector (^")i<i<n of independent r.v.s such that 

EXf = 0, Var(5„) = Y,E{X^f = 1. 

i<.n 

Suppose that the following Lindeberg's condition is satisfied: 

n 

Y,^{Xrfl{\Xr'\>e)^0 as n ^ oo for all e>0. (11.0.1) 
1=1 

T/jen£(E,<„^r) -^(0,1). 

Proof. First of all, I^C^^j^^X^^j is uniformly tight, because by Chebyshev's inequality 



»(|^xr|>M)<^ 

i<n 



< £ 



for large enough M. It remains to show that the characteristic function of Sn coverges to e 2 . For simplicity 
of notations let us omit the upper index n and write Xi instead of X". Since, 



i<n 



it is enough to show that 

logEe'^^" = ^log(l + (Ee*^-^- - 1 
It is an easy exercise to prove, by induction on m, that for any a G 



2 ■ 



e - 



E 

k<m 



k\ - (m+ 1)!' 



(11.0.2) 



(11.0.3) 
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(Just integrate this inequality to make the induction step.) Using this for m = 1, 



Ee 



iXXi 



jggiAX^ -j^jg^ 



< ^EXf < ^e' + ^EXfm^l >e)< X'e' < \ (11.0. 



for large n by (11.0.1) and for small enough e. Using the expansion of log(l + z) it is easy to check that 

1 



log(l + z)- z < |z|^ for \z\ < 



and, therefore, we can write 



2\2 



^|log(l + (Ee'^^* - 1)) - (Ee'^^* - l) < ^|Ee'^^' " If ^ E ^ i^^i) 

i<n i<n i<n 



< — (max EXf) V EXf = — max EXf 



i<n 



because, as in (11.0.4), 

EXf < + EXfl{\Xi\ > e) -> 
for large n by (11.0.1) and for e ^ 0. Finally, to show (11.0.2) it remains to show that 



^(Ee'^^*-1) 



i<n 



Using (11.0.3) for m = 1, on the event {\Xi\ > e}. 



- 1 - iXXi 



im>s)<-xn{{\x,\>e) 



and, therefore. 



iXXi 



1 - iXXi + ^Xf\l{\Xi\ >s)< X^Xfl{\Xi\ > e). 



Using (11.0.3) for m = 2, on the event {\Xi\ < e}. 



\2 



im<e)<^\Xi\H{\X,\<e)<^Xf. 



Combining the last two equations and using that EXi = 0, 



\2 

2 ' 



X^e^ 



<X^EXfl{\Xi\>s) + '^EXl 



Finally, 



i<n 



< 



i<n 

X^e 



i<n 



X^J2EXfl{\Xi\ >£) ^0 



as n — > oo (using Lindeberg's condition) and £ — > 0. 



Lemma 26 // P, Q are distributions on K such that P * Q = P then 



= 1. 
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Proof. Let us define 

fpit) = J e''-dF{x), fQ{t) = j e^'-dQix). 

The condition P*Q = P implies that ,fp{t)fQ{t) = fp{t). Since /p(0) = 1 and fp{t) is continuous, for small 
enough \t\ < e we have \fp{t)\ > and, as a result, fgit) = 1. Since 

fQ{t) = j cos{tx)dQ{x) + i j sm{tx)dQ{x) 

for \t\ < e this implies that / cos{tx)dQ{x) = 1 and since cos(s) < 1 this can happen only if 

Q(^{x:xt = mod 27r}) = 1 for all |i| < s. 

Take s,t such that |s|, \t\ < e and s/t is irrational. For x to be in the support of Q we must have xs = 27rfc 
and xt = 27rm for some integer k,m. This can happen only if a; = 0. 

□ 

Theorem 26 (Levy's equivalence) If {Xi) is a sequence of independent r.v. then J2i>i-^i converges a.s. iff 
in probability iff in law. 

Proof. We already proved (a Kolmogorov's theorem) that convergence in probability implies a.s. convergence. 
It remains to prove only that convergence in law implies convergence in probability. 

Suppose that C{Sn) P- Convergence in law implies that {£(S'„)} is uniformly tight which easily 
implies that {C{Sn — Sk)}n,k<\ is uniformly tight. This will imply that for any £ > 

n\Sn -Sk\>£)<e (11.0.5) 

fov n > k > N for large enough N. Suppose not. Then there exists e > and sequences {n{l)) and {n'{l)) 
such that n{l) < n'{l) and 

P(|5„'(0-^n(ol >e) >£■ 

Let us denote 1/ = Sn'Q,) — S'„(;). Since {£(!;)} is uniformly tight, by selection theorem, there exists a 
subsequence {l{r)) such that £(Y;(r)) Q. Since 

Sn'(l{r)) = Sn(l{r)) + ^i(r) and C{Sn'(l(r))) = 'C(S'„(/(r)) ) * £(F/(r)) 

letting r ^ oo we get that P = P*Q. By the above Lemma, Q({0}) = 1, which implies that P(|y;(r)| > e) < e 
for large r - a contradiction. Once (11.0.5) is proved, by Borel-Cantelli lemma we can choose a.s. converging 
subsequence as in Kolmogorov's theorem, and then by (11.0.5) 5„ converges in probability to the same limit. 

□ 

Theorem 27 (Three series theorem) Let (Xj)j>i be a sequence of independent r.v. and let 

Zi = Xi\{\Xi\ < 1). 

Then X]i>i -^i converges iff 
1- E.>iP(l^i|>l)<oo, 
2. Y^i-^i^Zi converges, 
3- Ei>iVar(ZO <oo. 

Proof. "<^=". Suppose 1-3 hold. Since 

> 1) = ^P(^^ ^ ^^) < OO 
i>l i>l 
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by Borel-Cantelli lemma V{{Xi ^ Zi} i.o.) = which means that X]i>i converges iff J2i>i converges. 
By 2, it is enough to show that J2i>i{^i ~ ^^i) converges, but this follows from Theorem 13 by 3. 
"=>". If J2i>i -^i converges a.s., 

P({|Xi| >l}i.o)=0 
and since {Xi) are independent, by Borel-Cantelli, 

^P(|Xi| >1) <oo. 

i>l 

If X^i>i Xi converges then, obviously, J2i>i converges. Let 

m<k<n 

Since Smn as m,n ^ oo, PdS'mnl > S) < S for any 6 > for m,n large enough. Suppose that 
X;i>iVar(Zi) = oo. Then 

<^mn = Var(5„„) = Var(Zfe) oo 

m<k<n 



as n ^ OO for any fixed m. Intuitively, this should not happen: Smn ^ in probability but their variance 
goes to infinity. In principle, one can construct such sequence of random variables but in our case it will be 
ruled out by Lindeberg's CLT. Because ~* oO) Lindeberg's theorem will imply that, 

Tmn= = 2^ ^^(0,1), 

m<k<n 



if m, n — > OO and cr4„ — * oo. We only need to check that 

m<k<n 



Zk — 



> e 



as TO, n, n — TO ^ 00. Since \Zk — E.^fe| < 2 and amn oo, the event in the indicator does not occur for large 
TO, n and, therefore, the sum is equal to 0. Next, since PdS'mnl < S) >1 — S we get 



m.rj ~r 



<^l>l-5. 



But this is impossible, since Tmn is approximately standard normal and standard normal distribution does 
not concentrate near any constant. We proved that X]i>i Var(Zi) < oo. By Kolmogorov's SLLN this implies 
that X]i>i(-^i — EZi) converges and, therefore, J2i>i^^i converges. 

□ 
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